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Acquisition  plays  a  vitai  role  in  nationai  defense  of  the  United  States.  But, 
defense  acquisition  can  be  quite  difficuit,  and  few  would  argue  that  current 
acquisition  processes  perform  in  an  optimai  manner.  The  magnitude  of  change 
mandated  by  FASA  and  DAWIA,  aiong  with  changes  mandated  from  within 
DoD,  is  such  that  “business  as  usual”  no  longer  represents  a  viable  alternative 
for  acquisition  management.  The  military  procurement  process  in  general 
requires  reengineering,  and  the  research  described  in  this  paper  focuses  upon 
the  Request  for  Proposal  (RFP)  subprocess  in  particular.  The  use  and  utility  of 
a  knowledge-based  system  to  support  process  redesign  are  demonstrated, 
and  insight  is  provided  into  the  potential  of  Al-based  technologies  to 
dramatically  improve  military  procurement.  The  results  provide  the  basis  for  a 
number  of  conclusions  that  are  important  for  the  acquisition  professional,  and 
establish  an  agenda  for  future  research. 


Acquisition  plays  a  vital  role  in  na¬ 
tional  defense  of  the  United  States. 
The  armed  forces  depend  on  the 
acquisition  of  high-quality  and  reliable 
weapon  systems,  equipment,  support,  and 
services  for  their  defense  missions,  in 
peacetime  as  well  as  during  periods  of  in¬ 
ternational  tension  and  conflict.  But  get¬ 
ting  what  is  needed  can  he  quite  difficult. 
Because  many  of  these  systems  are  ex¬ 
ceedingly  sophisticated,  complex,  and  ex¬ 
pensive,  their  procurement  is  complicated 
and  involved.  Further,  those  whose  joh  it 
is  to  acquire  systems  and  services  work  in 
an  environment  of  arcane  laws,  regula¬ 
tions,  policies,  and  procedures,  for  which 
a  considerable  investment  in  education 


and  training  is  required.  And,  this  legal  and 
regulatory  environment  is  constantly 
changing,  which  requires  vigilant  atten¬ 
tion  and  incessant  retraining  of  acquisi¬ 
tion  professionals  so  that  their  knowledge 
remains  current. 

Moreover,  few  would  argue  that  cur¬ 
rent  acquisition  processes  perform  in  an 
optimal  manner.  Rather,  the  costs  required 
to  staff  and  manage  defense  procurement 
consume  a  substantial  portion  of  acquisi¬ 
tion  funding,  and  procurement  adminis¬ 
trative  lead  time  (PALT)  represents  a  ma¬ 
jor  factor  in  weapon  system  planning  and 
logistics.  Indeed,  legislation  such  as  the 
Federal  Acquisition  Streamlining  Act 
(FASA)  and  the  Defense  Acquisition 
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Workforce  Improvement  Act  (DAWIA), 
along  with  changes  (e.g.,  performance 
specifications  and  standards,  preference 
for  commercial  items,  integrated  process 
teams)  mandated  from  within  the  Depart¬ 
ment  of  Defense  (DoD),  require  dramatic 
improvement  in  performance  of  the  mili¬ 
tary  procurement  process.  To  exacerbate 
the  difficulties  inherent  in  this  perfor¬ 
mance-improvement  task,  the  mandates 
come  at  a  time  when  defense  appropria¬ 
tions  are  declining  suhstantially,  acquisi¬ 
tion  staffs  are  getting  much  smaller,  and 
many  procurement  organizations  are  now 
obligated  to  fund  themselves  on  a  fee-for- 
service  basis  (i.e..  Defense  Business  Op¬ 
erations  Fund  (DBOF)). 

The  magnitude  of  required  improve¬ 
ment  is  such  that  “business  as  usual”  no 
longer  represents  a  viable  alternative  for 
acquisition  management.  Neither  can 
management  expect  to  achieve  process 
improvements  of  the  magnitude  required 
through  the  incremental  methods  (Ham¬ 
mer  &  Champy,  1993)  of  continuous  pro¬ 
cess  improvement  (CPI);  rather,  the  kinds 
of  dramatic  performance  improvements 
that  are  needed  call  for  radical  process 
redesign  (Hammer,  1990) — that  is,  the 
military  procurement  process  requires 
reengineering. 


Reengineering 


Business  process  reengineering 
(BPR) — which  is  also  referred  to  as  busi¬ 
ness  engineering  (van  Mael,  1993),  pro¬ 
cess  innovation  (Davenport,  1993),  pro¬ 
cess  redesign  (Davenport  &  Short,  1990), 
and  simply  reengineering  (Hammer, 
1990) — has  been  defined  as  “. .  .  the^u- 
damental  rethinking  and  radical  redesign 
of  business  processes  to  achieve  dramatic 
improvements  in  critical,  contemporary 
measures  such  as  cost,  quality,  service,  and 
speed  [emphasis  added]”  (Hammer  & 
Champy,  1993,  p.  32).  The  fundamental 
nature  of  reengineering  relates  to  question¬ 
ing  assumptions;  that  is,  taking  nothing 
about  a  business  or  organization  as  fixed 
or  given,  and  challenging  the  appropriate¬ 
ness  and  existence  of  every  aspect  of  busi¬ 
ness  organization  and  operation.  “Radical” 
redesign  refers  to  transforming  even  the 
most  enduring,  stable,  and  central  aspects 
of  a  design  configuration,  and  envision¬ 
ing  new  redesign  alternatives  without  limi¬ 
tations  or  constraints  associated  with  a 
current  design.  “Dramatic”  improvement 
implies  that  the  level  of  performance  is 
expected  to  increase  by  several  fold  (e.g., 
2x,  5x),  as  opposed  to  incremental  im¬ 
provements  that  are  generally  measured 
in  percentages  (e.g.,  5%,  20%). 
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Although  the  focus  of  BPR  has  been 
primarily  on  the  private  sector,  many  fed¬ 
eral  agencies  are  also  actively  involved 
with  reengineering.  These  federal 
reengineering  endeavors  generally  fall 
under  the  rubric  of  the  “reinventing  gov¬ 
ernment”  program  (U.S.  Government, 
1993a),  and  have  led  to  the  development 
of  several  “reinvention  labs”  (U.S.  Gov¬ 
ernment,  1993b)  across  the  country.  Nu¬ 
merous  cases  of  reengineering  in  the  gov¬ 
ernment  sector  can  be  found  in  Electronic 
College  (1996).  Although  military  orga¬ 
nizations  and  processes  have  a  number  of 
unique  attributes,  many  of  the  tools,  tech¬ 
nologies,  methods,  and  redesigns  from 
business  process  reengineering  apply 
equally  well  to  organizational  processes 
such  as  military  procurement.  One  such 
currently  emerging  technology  is  knowl¬ 
edge-based  reengineering. 

Knowledge-Based  Reengineering 


The  term  knowledge-based  reengi¬ 
neering  refers  to  the  use  of  knowledge- 


based  systems  (KBSs)  to  automate  and 
support  process  redesign.  Integrating  some 
powerful  methods  and  technologies  of  ar¬ 
tificial  intelligence  (AI)  with  a  number  of 
expert  reengineering  methodologies  from 
the  consulting  practice,  the  knowledge- 
based  system  KOPeR  (knowledge-based 
organizational  process  redesign)  (pro¬ 
nounced  “cope-er”)  was  designed  to  pro¬ 
vide  automated  reengineering  support 
(Nissen,  1995).  The  KOPeR  design  draws 
from  the  AI  methods  and  technologies  that 
led  to  the  development  of  many  powerful 
KBSs,  each  of  which  has  enabled  dramatic 
improvements  in  organizational  processes. 
These  include,  for  example,  the  Rl/XCON 
system  (McDermott,  1982),  MYCIN 
(Shortliffe,  1976),  SOPHIE  (Brown  et  al., 
1982),  the  CEUES  system,  and  the 
Authorizer’s  Assistant  (Eaudon  & 
Eaudon,  1994,  pp.  599,  606).  Many  such 
“intelligent”  systems  have  demonstrated 
professional  levels  of  performance  that 
meet  and  exceed  those  of  engineers,  phy¬ 
sicians,  and  financial  managers. 

Eigure  1  delineates  the  redesign  meth¬ 
odology  supported  by  KOPeR.  An  orga- 
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nizational  process  in  the  field  is  first  rep¬ 
resented  in  terms  of  a  computer-based 
model;  such  computer-based  modeling 
now  represents  standard  reengineering 
practice,  and  the  Integrated  Definition 
family  (e.g.,  IDEF  0,  IDEF  3)  provides  a 
standardized  representational  formalism 
for  modeling  organizational  processes. 
Because  the  IDEF  (and  nearly  all  other 
BPR  modeling)  tools  are  graph-based  (i.e., 
comprised  of  nodes,  edges,  and  attributes), 
a  battery  of  graph-based  diagnostic  pro¬ 
cess  measures 
can  be  obtained 
automatically 
by  KOPeR.  As 
diagnostics, 
these  measure¬ 
ments  are  used 
to  detect  the  se¬ 
vere  patholo¬ 
gies  and  faults 
associated  with 
a  process,  and  KOPeR  employs  its  base 
of  formalized  reengineering  knowledge 
(i.e.,  knowledge  base)  to  predict  which  re¬ 
design  transformations  are  most  likely  to 
effect  dramatic  improvement  in  process 
performance.  These  transformations  are 
then  applied  to  the  baseline  (i.e.,  “as  is”) 
process  model  to  generate  one  or  more  re¬ 
design  alternatives  for  the  process  (i.e.,  the 
“to  be”  scenarios). 

Finally,  once  a  dynamic  process  model 
has  been  validated  and  calibrated  against 
the  process  baseline,  simulation  is  em¬ 
ployed  to  test  the  performance  of  each  re¬ 
design  alternative.  This  represents  a  very 
efficient  technique  to  evaluate  alternate 
process  redesigns,  and  to  reduce  the  in¬ 
herent  risks  of  reengineering  before  com¬ 
mitting  time  and  money  to  a  problematic 
implementation.  Standard  methods  of 


evaluation  and  decision  making  (e.g.,  cost/ 
benefit  analysis,  functional  economic 
analysis,  multi- attribute  decision  making, 
etc.)  can  be  used  to  select  the  highest  po¬ 
tential  redesign  alternative,  which  then  be¬ 
comes  the  focus  of  organizational  plan¬ 
ning  and  implementation. 

Reengineering  the  RFP  Process 

KOPeR  and  its  corresponding  redesign 
methodology  were  used  in  an  investiga¬ 
tion  to  reengineer  several  processes  asso¬ 
ciated  with  military  procurement.  A  ma¬ 
jor  Navy  procurement  organization  was 
the  focus  of  this  investigation,  in  part  be¬ 
cause  its  organization,  processes,  and  tech¬ 
nologies  appear  to  be  representative  of 
those  found  across  any  number  of  mili¬ 
tary  sites  and  bases;  hence  the  results  from 
this  investigation  are  inherently  general- 
izable,  not  only  to  other  Navy  organiza¬ 
tions,  but  to  procurement  processes  across 
the  range  of  service  components,  govern¬ 
ment  agencies,  and  major  corporations. 
This  Navy  procurement  organization  is 
part  of  a  national  reinvention  laboratory, 
which,  by  definition,  has  expressed  an 
explicit  interest  in  process  innovation,  and 
it  is  also  perceived  to  be  well-managed, 
having  already  institutionalized  Total 
Quality  Management  (TQM),  and 
achieved  a  number  of  impressive  process 
improvements  (e.g.,  the  use  of  electronic 
data  interchange  [EDI]  and  bankcards  for 
small  and  micro  purchases,  respectively). 
Because  these  procurement  processes  are 
acknowledged  to  perform  relatively  well 
to  begin  with,  we  have  a  good  opportu¬ 
nity  to  demonstrate  the  use  and  utility  of 
KOPeR  and  knowledge-based  reengi¬ 
neering. 


"KOPeR  and  its 
corresponding 
redesign  melhodoi- 
ogy  were  used  in  an 
investigation  to 
reengineer  severai 
processes  associated 
with  miiitary  pro¬ 
curement." 
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Table  1 :  Key  RFP  Process 

Measurements 

Measure 

Value 

Process  size 

255 

Process  length 

255 

Parallelism 

1.00  * 

Handoff  fraction 

0.24 

IT-Support  fraction 

0.08 

IT-Communication  fraction 

0.00 

IT-Automation  fraction 

0.00  * 

*  indicates  theoretical  minimum 

RFP  Process  Measurements 
AND  Diagnostics 


Table  1  summarizes  a  subset  of  the  key 
RFP  process  measurements  and  diagnos¬ 
tics.  The  process  size  (255)  measures  the 
number  of  activities  required  for  an  RFP, 
the  magnitude  of  which  indicates  that  the 
process  is  relatively  large;  process  size  is 
generally  related  positively  to  activity- 
based  cost  (O’ Guinn,  1991),  whereas  pro¬ 
cess  length  is  thought  to  drive  activity 
cycle  time  (Stalk  &  Hout,  1990).  The  par¬ 
allelism  measurement  (size  divided  by 
length)  represents  a  theoretical  minimum 
for  that  measure;  that  is,  the  value  (1.00) 
indicates  that  the  RFP  process  flow  is  en¬ 
tirely  sequential,  with  each  of  its  activi¬ 
ties  performed  in  a  strict  linear  fashion. 
The  handoff  fraction  measures  the  per¬ 
centage  of  process  activities  associated 
with  organizational  handoffs;  handoffs  are 
generally  associated  with  work  sitting  in 
in-boxes  and  out-boxes — awaiting  assign¬ 
ment,  performance,  reviews,  and  manage¬ 
rial  approval — which  adversely  affects 
process  cycle  time.  By  comparison  with 


other  procurement  processes,  the  value 
(0.24)  obtained  for  the  RFP  suggests  that 
much  of  the  PALT  associated  with  this  pro¬ 
cess  may  be  driven  by  handoffs. 

The  fractional  metrics  associated  with 
information  technology  (IT)  measure  the 
density  of  three  classes  of  IT  in  organiza¬ 
tional  processes:  support,  communication, 
and  automation.  The  IT-Support  measure¬ 
ment  (0.08)  is  very  low  for  the  kind  of 
knowledge-  and  information-work  in¬ 
volved  in  the  RFP  process,  and  indicates 
that  most  process  activities  are  performed 
manually.  Worse,  the  IT-Communication 
fraction  is  indistinguishable  from  zero  (to 
2  decimal  places),  which  indicates  that 
nearly  all  process  communications  are 
paper-based.  Moreover,  the  IT-Automa- 
tion  fraction  (0.00)  reflects  the  theoreti¬ 
cal  minimum  for  that  measure,  which  in¬ 
dicates  a  labor-intensive  process. 

To  summarize,  the  baseline  RFP  pro¬ 
cess  represents  a  labor-intensive,  linear 
sequence  of  manual,  paper-based  activi¬ 
ties  that  are  interspersed  between  numer¬ 
ous  handoffs  and  reviews.  The  implica¬ 
tion  is  that  the  process  has  a  number  of 
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pathologies  and  faults,  which  appear  to 
adversely  impact  its  cost  and  cycle  time. 
Recall  that  the  RFP  process  is  currently 
considered  to  represent  a  well-managed 
set  of  acquisition  activities.  Having  diag¬ 
nosed  these  pathologies  and  faults, 
KOPeR  next  concentrates  on  reducing 
process  linearity  through  a  workflow 
transformation,  and  applies  three  IT-hased 
redesign  transformations  to  overcome  the 
manual,  paper-hased,  lahor-intensive 
shortcomings  of  the  process.  KOPeR  em¬ 
ploys  these  transformations  to  generate  the 
redesign  alternatives  helow. 

Redesign  Alternatives 


Referring  hack  to  the  methodology  de¬ 
picted  in  Figure  1,  KOPeR  utilizes  its  mea¬ 
surements  and  diagnostics  to  predict  one 
or  more  redesign  transformations  that  have 
good  potential  to  effect  dramatic  perfor¬ 
mance  improvement  through  process  in¬ 
novation.  The  methodology  also  calls  for 
a  team  of  process  experts  from  the  pro¬ 
curement  organization  to  review  all  of  the 
KOPeR-generated  transformations,  using 
criteria  such  as  feasibility,  implementahil- 
ity,  perceived  benefit,  and  the  like.  Of  the 
40  or  so  redesign  transformations  pre¬ 
dicted  by  KOPeR,  the  corresponding  mea¬ 
surement  information  helps  the  team  of 
experts  to  focus  on  three  IT-based  enabling 
technologies  that  are  perceived  to  have  the 
highest  potential  for  improvement:  a)  pro¬ 
curement  workflow  systems,  b)  expert  re¬ 
view  systems,  and  c)  knowledge-based 
composition  systems.  As  an  aside,  the 
reader  should  note  that  current 
reengineering  practice  (e.g.,  Davenport, 
1993)  guides  against  process  innovation 
based  solely  on  IT-based  transformations. 


yet  IT  continues  to  represent  the  central 
enabling  technology  for  process  redesign. 
These  transformations  are  discussed  in 
turn. 

Procurement  workflow  systems.  Work- 
flow  systems  can  enable  the  kinds  of  IT- 
based  process  support  and  communication 
that  are  absent  from  the  baseline  RFP  pro¬ 
cess.  Workflow  systems  provide  a  com¬ 
puter-based  infrastructure  for  the  routing, 
storage,  and  support  of  electronic  docu¬ 
ments,  which  can  greatly  reduce  the  time 
required  for  work  to  move  between  activi¬ 
ties.  The  basic  workflow  system  used  to 
support  the  RFP  process  combines  fea¬ 
tures  generally  associated  with  a  database 
management  system  (DBMS)  for  indexed 
storage  and  retrieval  of  work  documents 
at  various  stages  of  completion,  along  with 
those  of  an  electronic  communication  ap¬ 
plication  such  as  e-mail,  which  can  be  used 
to  transmit  work  documents  to  the  vari¬ 
ous  organizational  agents  involved  in  a 
process.  Additionally,  the  sequence  of 
steps  and  agents  involved  in  a  process  is 
generally  enumerated  beforehand,  and 
used  to  automatically  route  work  to  the 
proper  agent,  when  the  work  is  required 
to  be  completed. 

Other  system  capabilities  can  include 
templates  to  describe  the  overall  flow  of 
work  in  a  process,  along  with  on-line  pro¬ 
cess  “help”  and  reference  information 
(e.g.,  regulations,  contract  clauses,  etc.). 
A  number  of  commercial  workflow  appli¬ 
cations  is  available  on  the  market,  and 
several  firms  have  expertise  in  customiz¬ 
ing  workflow  applications  to  support  a 
particular  organization  and  process  such 
as  Navy  RFP  preparation.  The  implemen¬ 
tation  of  workflow  systems  requires  a  con¬ 
siderable  investment,  however,  not  only 
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in  computer  hardware,  software,  and  de¬ 
velopment,  but  also  in  personnel  training, 
system  maintenance,  and  process  control. 
Interestingly,  at  the  time  of  this  writing, 
the  process  participants  also  indicate  that 
a  decision  has  been  made  to  purchase, 
customize,  and  implement  just  such  a  pro¬ 
curement  workflow  system. 

Review  expert  systems.  Expert  systems 
are  capable  of  performing  many  of  the 
reviews  required  by  contracting  officers 
and  lawyers,  and  can  enable  the  kind  of 
IT-based  automation  of  process  activities 
that  is  missing  from  the  baseline  RFP  pro¬ 
cess.  The  expert  systems  transformation 
addresses  the  various  high-level  reviews 
of  RFP  documents  that  are  conducted  by 
contracting  officers  (KOs)  and  legal  rep¬ 
resentatives.  These  important  reviews  pre¬ 
vent  errors  and  mistakes  from  affecting 
RFPs  and  subsequent  contracting  activi¬ 
ties  downstream  in  the  acquisition  process, 
and  they  require  considerable  skill  and 
experience  on  the  part  of  the  KOs  and  law¬ 
yers  involved.  Hence,  this  requires  rela¬ 
tively  sophisticated  AI  technology  re¬ 
quired  to  reproduce  the  performance  of 
such  highly  skilled  experts. 

Alternatively,  a  great  many  aspects  of 
military  procurement  are  governed  by 
laws  and  regulations,  which  are  articulated 
through  the  U.S.  Code  (USC),  Federal 
Acquisition  Regulations  (FAR),  Defense 
FAR  Supplement  (DEARS),  and  other 
widely  distributed  documentation;  hence, 
many  of  the  RFP  reviews  offer  good  po¬ 
tential  for  automation  via  (esp.  rule-based) 
expert  systems.  Although  complete  auto¬ 
mation  is  impractical  (and  probably  un¬ 
desirable),  the  review  tasks  can  still  be 
shared  between  human  and  computer 
agents.  For  example,  following  something 


of  a  “80/20  rule,”  if  80  percent  of  RFP 
reviews  are  routine  and  perfunctory  in  na¬ 
ture,  then  these  can  be  assigned  to  the 
machine  agent;  the  human  experts  (i.e., 
KOs  and  lawyers)  can  then  handle  the  re¬ 
maining  20  percent  that  are  more  difficult 
or  complex.  Such  a  scheme  for  (human/ 
machine)  task  sharing  has  precedence  in 
industry  (e.g.,  engineering  design,  credit 
review,  loan  approval),  and,  although  its 
transformation  is  predicated  on  relatively 
sophisticated  AI 
technology,  the 
regulation- 
based  nature  of 
the  acquisition 
domain  makes 
it  nearly  ideal 
for  expert  sys¬ 
tems  develop¬ 
ment.  Indeed, 
this  transformation  in  no  way  pushes 
against  the  frontiers  of  AI  in  computer  sci¬ 
ence;  rather,  it  represents  the  adaptation 
of  established  technology  to  the  acquisi¬ 
tion  domain,  and  the  kind  of  expert  RFP 
review  systems  described  here  is  well 
within  current  expert  systems  capabilities. 

Composition  knowledge-based  sys¬ 
tems.  Knowledge-based  systems  are  simi¬ 
lar  in  spirit  to  the  expert  systems  above  in 
that  they  automate  tasks.  The  primary  dif¬ 
ference  lies  in  the  sophistication  of  knowl¬ 
edge-based  systems,  as  they  do  not  require 
performance  at  the  level  of  an  expert  (e.g., 
KO,  lawyer);  rather,  their  level  of  knowl¬ 
edge  and  performance  is  lower,  more  on 
the  order  of  an  analyst  or  information 
worker  like  the  Contract  Specialist  (CS). 
As  such,  the  technological  challenge  is 
greatly  reduced,  even  from  that  of  the  re¬ 
view  expert  systems  above,  yet  the  poten- 


"Allheugh  complete 
aulemalien  is  im¬ 
practical  (and  prob¬ 
ably  undesirable), 
the  review  tasks  can 
still  be  shared  be¬ 
tween  human  and 
computer  agents." 
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Table  2:  Redesigned  RFP  Process  Performance 


Redesign  Alternative 

Cost 

Cycletime 

Procurement  Workflow  Systems 

nil 

28% 

Review  Expert  Systems 

11% 

33% 

Composition  KBS 

52%  * 

67%  * 

*  Exceeds  performance-doubling  threshold. 

tial  for  dramatic  performance  improve¬ 
ment  remains.  This  makes  the  KBS  rede¬ 
sign  very  attractive. 

The  work  to  he  accomplished  hy  such 
knowledge-hased  systems  involves  docu¬ 
ment  composition.  This  generally  entails 
activities  such  as  (a)  reviewing  the  back¬ 
ground  information  and  requirements  as¬ 
sociated  with  a  procurement;  (h)  describ¬ 
ing  the  supplies  and  services  to  be  pro¬ 
cured;  (c)  selecting  the  appropriate 
clauses,  specifications,  and  standards;  (d) 
outlining  proposal  instructions,  schedules, 
and  delivery  information;  and  (e)  using 
these  elements  to  compose  the  proper  RFP 
sections.  Depending  on  the  level  of  de¬ 
sired  “intelligence”  and  functionality,  a 
composition  KBS  can  also  be  developed 
to  make  recommendations  regarding  con¬ 
tract  types,  incentives,  and  other  higher- 
level  activities,  in  addition  to  being  em¬ 
bedded  directly  into  the  kind  of  procure¬ 
ment  workflow  system  described  above. 
Indeed,  in  the  simulations  that  follow,  such 
a  procurement  workflow  system  is  pre¬ 
sumed  to  exist,  and  provides  a  digital 
document  infrastructure  to  support  both 
RFP  composition  and  expert  review.  As 
above,  complete  automation  of  the  RFP 
document  composition  process  is  imprac¬ 


tical  (and  probably  undesirable),  but  ex¬ 
tant  KBS  technology  should  be  capable 
of  incorporating  most  of  the  associated 
process  activities  (perhaps  similar  to  the 
80/20  split  above). 

Simulation  Results 


Simulation  represents  a  powerful  com¬ 
puter-based  capability  for  evaluating  the 
relative  performance  of  numerous  alter¬ 
natives  in  a  very  short  amount  of  time,  and 
for  gauging  the  effects  of  management  de¬ 
cision-making  alternatives — such  as  com¬ 
peting  process  redesigns — before  commit¬ 
ting  time  and  money  to  a  particular  alter¬ 
native  (Hansen,  1994;  van  Mael,  1993). 
This  point  is  very  important,  as  many  BPR 
methodologies  omit  this  testing  step,  and 
jump  directly  from  process  redesign  into 
implementation  of  a  particular  technology. 
The  simulation  of  redesign  alternatives  is 
generally  much  less  time-consuming  and 
expensive  than  conducting  pilot  projects, 
particularly  when  a  relatively  large  num¬ 
ber  (say  three  or  more)  of  alternatives  is 
involved;  further,  simulation  is  much, 
much  faster  and  cheaper  than  implement¬ 
ing  an  inappropriate  redesign  alternative. 


94 


Reengineering  the  RFP  Process  through  Knowledge-Based  Systems 


Table  2  provides  a  summary  of  simula¬ 
tion  results  for  the  three  IT-based  RFP  re¬ 
design  alternatives.  The  simulated  perfor¬ 
mance  of  each  IT-based  redesign  alterna¬ 
tive  is  projected  for  a  period  of  one  fiscal 
year,  and  compared  with  that  of  the  RFP 
process  baseline  in  terms  of  activity  cost 
and  cycle  time.  The  figures  shown  in  the 
table  reflect  the  percentage  process  im¬ 
provement  over  the  baseline  RFP  process. 
For  purposes  of  significance,  a  perfor¬ 
mance-doubling  threshold  is  established 
for  “dramatic”  (i.e.,  2x)  improvement;  that 
is,  either  cost  or  cycle  time  must  be  re¬ 
duced  by  at  least  half  (50%)  to  merit  con¬ 
sideration  as  a  process  innovation.  Alter¬ 
natives  that  do  not  to  at  least  double  per¬ 
formance  are  better  classified  as  CPI  ini¬ 
tiatives  than  as  BPR  transformations. 

Workflow  systems  performance.  First, 
notice  that  the  workflow  systems  trans¬ 
formation  effected  only  a  modest  (28%) 
improvement  in  cycle  time,  and  had  a  neg¬ 
ligible  impact  on  process  cost.  Given  the 
potential  for  improvement  noted  above, 
this  may  appear  surprising,  for  workflow 
systems  can  greatly  reduce  the  communi¬ 
cation  time  between  process  activities,  and 
provide  the  capability  to  automatically 
route  work  documents  (at  the  right  time) 
to  the  appropriate  agents.  These  results 
also  ran  counter  to  the  intuition  of  pro¬ 
cess  experts  and  participants,  as  they  con¬ 
sidered  this  technology  to  have  the  great¬ 
est  redesign  potential.  Through  analysis, 
however,  one  discovers  that  workflow 
systems  do  not  change  the  process  activi¬ 
ties  that  must  be  performed;  rather,  they 
change  only  the  environment  and  inter¬ 
face  within  which  the  performance  of  such 
activities  takes  place.  Such  simple  inser¬ 
tion  of  IT  into  an  organizational  process 


has  been  colorfully  referred  to  as  “paving 
the  cowpaths”  and  “automating  the  mess” 
(Hammer,  1990).  Using  a  workflow  inter¬ 
face  can  sometimes  even  impede  the  per¬ 
formance  of  certain  tasks. 

For  example,  using  a  slow,  tedious,  or 
non-intuitive  interface  to  consult  on-line 
regulations  or  other  references  can  require 
more  effort  than  simply  opening  a  (paper- 
based)  desk  ref¬ 
erence  (e.g.,  the 
FAR).  Addi¬ 
tionally,  most 
workflow  sys¬ 
tems  are  config¬ 
ured  with  the 
electronic 
equivalents  of 
in-boxes  (e.g., 
task  lists)  and 
out-boxes,  as  agents  must  deliberately 
“open”  their  tasks  before  processing. 
Therefore,  although  the  communication 
between  process  activities  is  much  faster 
through  workflow  systems,  without  rede¬ 
signing  the  underlying  process  itself,  the 
actual  latency  of  documents  awaiting  pro¬ 
cessing  does  not  necessarily  improve 
through  the  technology.  Moreover,  imple¬ 
mentation  of  IT  such  as  a  procurement 
workflow  system  requires  customization, 
training,  maintenance,  and  support,  in  ad¬ 
dition  to  the  associated  computer  and  net¬ 
work  hardware  and  software  costs.  Based 
on  these  results,  the  procurement  work- 
flow  system  does  not  portend  the  kind  of 
dramatic  performance  improvement  ex¬ 
pected  through  process  innovation — at 
least  not  as  a  standalone  alternative,  or  as 
an  end  in  and  of  itself. 

Expert  systems  performance.  The  re¬ 
view  expert  systems  redesign  reduced 


"Such  simple  inser- 
lien  of  IT  into  an 
organizational 
process  has  heen 
colorfully  referred  to 
as  'paving  the 
cowpaths'  and  'auto¬ 
mating  the  mess'" 
(Hammer,  1990) 
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both  cost  (11%)  and  cycle  time  (33%)  for 
the  RFP  process.  Notice,  however,  that 
neither  the  cost  nor  cycle-time  improve¬ 
ment  exceeds  the  performance-doubling 
threshold.  These  results  also  appear  sur¬ 
prising,  and  ran  counter  to  the  intuition  of 

process  experts 
and  partici¬ 
pants;  they  con¬ 
sidered  this  ad¬ 
vanced  technol¬ 
ogy  to  have  ex¬ 
cellent  redesign 
potential,  and, 
given  the  fact 
that  the  KO  and 
legal  review 
tasks  are  automated  through  the  expert 
systems,  much  greater  improvements  in 
process  performance  were  expected. 

Through  analysis  one  discovers  that, 
although  these  review  tasks  represent  criti¬ 
cal  steps  to  ensure  the  quality  and  profes¬ 
sionalism  of  RFPs,  the  reviews  do  not  rep¬ 
resent  high-leverage  activities  for  process 
redesign;  in  other  words,  the  review  ac¬ 
tivities  are  very  important,  hut,  as  a  per¬ 
centage  of  the  total  process  cost  and  cycle 
time,  they  do  not  represent  the  major  con¬ 
tributors  in  terms  of  activities.  Hence,  only 
modest  performance  improvements  can  be 
expected  to  accrue  through  the  automa¬ 
tion  of  these  RFP  review  activities. 

Knowledge-based  systems  perfor¬ 
mance.  In  contrast  with  the  modest  per¬ 
formance  improvements  projected  above 
for  the  workflow-  and  expert-systems  re¬ 
design  transformations,  the  knowledge- 
based  systems  used  for  RFP  document 
composition  exceeded  the  performance¬ 
doubling  threshold  for  both  cost  (52%) 
and  cycle  time  (67%),  reflecting  the  kind 


of  dramatic  gains  expected  through 
reengineering.  These  results  were  also  sur¬ 
prising  and  counter-intuitive,  but  for  very 
different  reasons.  As  noted  above,  the 
composition  KBS  transformation  repre¬ 
sents  less  technological  sophistication 
with  respect  to  the  review  expert  systems, 
yet  the  payoff  from  this  redesign  interven¬ 
tion  is  dramatic.  This  provides  an  inter¬ 
esting  insight  into  the  relationship  between 
technological  sophistication  (and  risk)  and 
process  improvement  (i.e.,  payoff),  and 
casts  some  doubt  on  a  widely  espoused 
notion  that  major  improvements  require 
the  most  advanced  technologies. 

Through  analysis  one  discovers  that  the 
relative  success  of  this  redesign  transfor¬ 
mation  is  attributable  to  the  high  leverage 
associated  with  RFP  composition  activi¬ 
ties.  Recall  that  this  provides  a  contrast  to 
the  relatively  low  leverage  observed 
through  the  RFP  review  activities  from 
above.  Specifically,  unlike  the  RFP  review 
activities  that  are  automated  through  the 
expert  systems  transformation — which  we 
indicated  contributes  a  relatively  low  per¬ 
centage  to  total  process  cost  and  cycle 
time — the  RFP  composition  activities  con¬ 
stitute  the  bulk  of  process  tasks  required 
to  prepare  RFPs.  In  other  words,  for  this 
particular  RFP  process,  the  contract 
specialist’s  document-composition  activi¬ 
ties  offer  the  greatest  potential  for  im¬ 
provement  in  terms  of  automation,  and  the 
KBS  technology  targets  these  composition 
activities  directly. 

Finally,  it  is  important  to  reiterate  that 
all  three  of  these  IT-based  transformations 
neglect  the  integration  of  other,  well-es¬ 
tablished  enablers  of  process  innovation 
(e.g.,  organizational  design,  and  human  re¬ 
sources;  see  Davenport,  1993).  Although 
a  number  of  corresponding,  non-lT  trans- 


•••  the  knowledge - 
based  systems  used 
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cost  (52%)  and  cycie 
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formations  (e.g.,  case  manager,  process 
teams,  delegation,  empowerment,  incen¬ 
tives)  were  identified  by  KOPeR,  the  team 
of  process  experts  did  not  feel  as  though 
changes  to  the  existing  procurement  or¬ 
ganizational  or  human-resource  structure 
would  be  feasible  at  the  time  of  the  inves¬ 
tigation.  As  noted  above,  concentrating 
solely  on  IT-based  transformations  is  not 
recommended  by  current  reengineering 
practice.  However,  considering  that  the  IT- 
based  transformations  above  may  still  be 
combined  with  other  (i.e.,  non-IT)  enablers 
at  a  later  date,  the  near-term  prospect  for 
effecting  the  magnitude  of  process  im¬ 
provement  examined  through  this  inves¬ 
tigation  must  be  exciting  to  today’s  pro¬ 
curement  manager.  Have  faith,  because 
current  practice  also  recommends  against 
trying  to  do  everything  at  once. 

Conclusions  and  Future  Research 

This  article  has  investigated  the  rede¬ 
sign  of  the  RFP  process  as  conducted  by 
one  well-managed  Navy  procurement  or¬ 
ganization.  The  research  shows  that 
KOPeR  proved  to  be  successful  in  sup¬ 
porting  the  modeling,  measurement,  diag¬ 
nosis,  and  redesign  of  the  RFP  process, 
and  simulation  played  a  critical  role  in  the 
evaluation  and  comparison  of  redesign  al¬ 
ternatives.  Without  the  simulation  results 
above,  for  example,  other  procurement 
managers  may  have  been  tempted  to 
implement  procurement  workflow  sys¬ 
tems  similar  to  the  transformation  de¬ 
scribed  above,  without  an  appreciation  for 
the  expected  costs  and  limitations  of  this 
redesign  alternative.  Based  solely  on  the 
procurement  workflow  system,  such  man¬ 
agers  can  anticipate  negligible  overall  cost 


savings,  and  only  modest  improvement  in 
cycle-time  performance;  hence,  the  pru¬ 
dence  of  this  redesign  decision  (i.e.,  to 
implement  only  the  workflow  system) 
appears  to  be  questionable.  This  result 
may  provide  useful  guidance  to  the  de¬ 
signers  and  decision  makers  now  respon¬ 
sible  for  the  DoD  Standard  Procurement 
System  (SPS)  development  (SPS,  1996); 
the  functionality  of  SPS  is  expected  to  be 
very  similar  to  the  procurement  workflow 
systems  described  above. 

This  research  also  identified  the  review 
activities  of  contracting  officers  and  legal 
advisors  as  tar¬ 
get  opportuni-  KBS  transfer- 

ties  for  automa-  nialien  exceeded  all 
tion  through  ex-  ether  redesign  alter- 
pert  systems,  natives  in  terms  of 
KOs  and  law-  dramatic  performance 
yers  represent  improvement." 
well-paid, 

highly  trained  professionals  that  are  criti¬ 
cal  to  the  RFP  process,  and  automating 
their  reviews  through  expert-systems  tech¬ 
nology  was  perceived  to  represent  an  ex¬ 
cellent  opportunity  for  process  improve¬ 
ment.  However,  even  with  the  workflow 
systems  infrastructure  (which  KOPeR  in¬ 
dicated  was  a  necessary  condition  for  ex¬ 
pert  systems’  efficacy),  this  redesign  trans¬ 
formation  failed  to  exceed  the  perfor¬ 
mance-doubling  threshold  for  process  im¬ 
provement.  Particularly  during  times  of 
tight  fiscal  constraint,  it  may  be  prudent 
to  subordinate  this  redesign  transforma¬ 
tion  to  others  that  reflect  greater  potential 
for  dramatic  performance  improvement. 

Specifically,  the  document-composition 
that  KBS  succeeded  in  more  than  halving 
both  the  cost  and  cycle  time  of  the  RFP  pro¬ 
cess.  Even  though  it  uses  less-sophisticated 
AI  technology  than  the  review  expert  sys- 
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terns,  the  KBS  transformation  exceeded  all 
other  redesign  alternatives  in  terms  of  dra¬ 
matic  performance  improvement.  This  high¬ 
lights  an  exciting  opportunity  to  further  ex¬ 
plore  such  composition  KBSs,  and  possi¬ 
bly  to  couple  this  promising  KBS  technol¬ 
ogy  with  current  efforts  to  develop  and 
implement  the  next  generation  of  procure¬ 
ment  workflow  systems  (e.g.,  SPS). 

Further,  a  system  such  as  KOPeR  may 
itself  complement  current  efforts  to  cap¬ 
ture  other  acquisition  processes  through 
computer-based  modeling.  Because  of 
KOPeR’s  measurement-driven  diagnostic 
capability,  it  has  the  potential  to  run  “in 
the  background”  (i.e.,  as  a  non-user-di- 
rected  process)  of  emerging  process  tools 
such  as  Knowledge  Worker  (Knowledge- 

Worker,  1996), 
serving  to  sug¬ 
gest  potential 
redesign  trans¬ 
formations  even 
as  the  basic  pro- 
cess  informa¬ 
tion  is  being 
captured  and 
formalized 
through  the  sys¬ 
tem.  Indeed,  be¬ 
cause  workflow 
systems  themselves  depend  on  a  (com¬ 
puter-based)  process  model  to  function, 
KOPeR  could  also  operate  “behind  the 
scenes”  (i.e.,  outside  of  the  users’  imme¬ 
diate  views),  diagnosing  pathologies  and 
faults  in  the  underlying  workflow-en¬ 
hanced  processes  (e.g.,  helping  to  avoid 
“paving  the  cowpaths”  and  “automating 
the  messes”).  This  represents  another  in¬ 
teresting  area  for  future  research. 

As  an  immediate  topic  of  related  re¬ 
search,  recall  that  this  present  investiga¬ 


tion  is  designed  to  produce  results  that  are 
broadly  generalizable.  This  suggests  that 
KOPeR  and  the  RFP  redesign  transforma¬ 
tions  described  in  this  paper  offer  good 
potential  to  innovate  the  RFP  and  like  ac¬ 
quisition  processes  in  other  organizations. 
Given  the  regulatory  nature  of  defense 
acquisition,  one  would  expect  to  see  con¬ 
siderable  similarity  among  the  procure¬ 
ment  processes  of  various  naval  com¬ 
mands  (e.g.,  NAVAIR,  NAVSEA),  service 
components  (e.g..  Air  Force,  Army),  gov¬ 
ernment  agencies  (e.g.,  DOE,  DOT),  and 
major  corporations.  Generalizing  the  re¬ 
sults  of  this  present  investigation  repre¬ 
sents  an  opportunity  to  leverage  the  ben¬ 
efits  of  KOPeR  and  knowledge-based 
reengineering,  which  could  help  spark  AI- 
based  acquisition  process  innovation  on  a 
wide  scale. 

Einally,  acquisition  does  not  represent 
a  solitary  activity;  rather,  it  involves  the 
interaction  between  a  procuring  organiza¬ 
tion  and  one  or  more  contractors  submit¬ 
ting  proposals  and  supplying  goods  and 
services.  This  interaction  suggests  that  the 
kind  of  research  described  in  this  paper 
can  be  extended,  for  example  through  in¬ 
vestigations  to  integrate  the  government- 
REP  and  contractor-proposal  processes. 
Such  integration  could  lead  to  the  discov¬ 
ery  of  additional  opportunities  for  dra¬ 
matic  performance  improvement  through 
process  redesign.  In  the  spirit  of  acquisi¬ 
tion  reform  and  integrated  process  teams, 
research  along  this  line  also  has  the  po¬ 
tential  to  reduce  contractor  costs  (and 
cycle  times)  as  well  as  those  incurred  by 
procuring  organizations  directly.  Clearly, 
much  work  remains  to  be  done,  but 
KOPeR  and  its  IT-based  process  innova¬ 
tions  appear  to  offer  great  potential. 


"Finally,  acquisition 
does  not  represent  a 
solitary  activity; 
rather,  it  invoives 
the  interaction 
between  a  procuring 
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